Mott Transitions of Three-Component Fermionic Atoms with Repulsive Interaction in 

Optical Lattices 
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We investigate the Mott transitions of three-component (colors) repulsive fermionic atoms in 
optical lattices using the dynamical mean field theory. We find that for SU(3) symmetry breaking 
interactions the Mott transition occurs at incommensurate half filling. As a result, a characteristic 
Mott insulating state appears, where paired atoms with two different colors and atoms with the 
third color are localized at different sites. We also find another Mott state where atoms with two 
different colors are localized at different sites and atoms with the third color remain itinerant. 
We demonstrate that these exotic Mott phases can be detected by experimental double occupancy 
observations. 
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Ultracold fermionic atoms loaded in optical lattices 
have been providing ideal stages for studying fundamen- 
tal problems related to strong correlation effects 
The Mott transition, which is one of the most important 
phenomena as regards correlated electron systems, was 
observed in '^^'K fermionic atoms [1, Q. The research has 
been extended to the topics about the phase transition 
of multicomponent fermionic atoms. Recently, the Mott 
transition of six-component repulsive ^^"^Yb fermionic 
atoms in an optical lattice was investigated by double 
occupancy measurements of the site using the photo as- 
sociation spectroscopy Interestingly, one can cre- 
ate the odd-number-component systems, where novel fea- 
tures are expected to appear. In fact, degenerate three- 
component fermionic gases have been succsessfully cre- 
ated [Sjl and intensively investigated regarding the Efimov 
state 0. 

The Mott transition of three-component fermionic 
atoms in optical lattices was investigated for isotropic 
repulsive interactions with SU(3) symmetry [10]. It was 
shown that the Mott transition occurs at commensurate 
1/3 and 2/3 fillings, but never occurs at incommensu- 
rate half filling. However, in a recent study, we showed 
that the Mott insulating state appear even at incommen- 
surate half filling for SU(3) symmetry breaking interac- 
tions [TTIl . We also showed that fluctuation effects induce 
the color selective Mott transition (CSMT) state, where 
atoms with two different colors are localized at different 
sites and the third color atoms are itinerant. By analogy 
with strongly correlated electron systems |13 . [l3| . the 
Mott transition states are considered to extend at finite 
temperatures. Therefore, they are possibly observed in 
experiments. However, the reason for the appearance of 
the Mott transitions at half filling and the characteristics 
of the Mott transition states have not been unveiled yet. 

In this paper, we investigate the Mott transition of 
repulsively interacting three-component fermionic atoms 
in optical lattices. From the calculation of the double 



occupancy which can be observed experimentally 
we conclude that paired atoms with two different colors 
and atoms with the third color are localized at differ- 
ent sites in the Mott insulating state. We call this Mott 
insulating state a paired Mott insulator (PMI). This re- 
minds us of the Mott insulating state of Bose- Fermi mix- 
tures [l3|, even though we considere the repulsive inter- 
actions. From systematic calculations, rich phase dia- 
grams of the PMI, CSMT, and Fermi Hquid (FL) phases 
are obtained in terms of the anisotropy of the repulsive 
interactions. We demonstrate that these phases can be 
distinguished experimentally by observing double occu- 
pancy. We show that the phase transitions from the 
CSMT state to the PMI state are effectively described 
by the Falicov-Kimball model, which has been studied as 
a minimal model for the metal-insulator transition in d— 
and /—electron systems [Hj. We thus expect that the 
three-component optical lattice system allows us to sim- 
ulate widespread phenomena related to the Bose-Fermi 
mixtures and the correlated electrons with some orbitals. 

In accordance with the conventional model for cold 
atoms in optical lattices Q, we set the nearest- neighbor 
hopping and the on-site interaction between atoms with 
different colors. The low-energy properties can be de- 
scribed by the following Hamiltonian, 
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where the subscript (i, j) is the summation over the near- 
est neighbor sites, al^{aia) is the fermionic creation (an- 
nihilation) operator for the state with color a in the ith 
site and riia = al^Qia- Here, t denotes the hopping in- 
tegral, Ha is the chemical potential for the atom with 
color a, and Uap is the repulsive interaction between two 
atoms with colors a and /3. The hopping integral t is 
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used in units of energy. The chemical potential is set 
at /Xq, = {Uap + Uja)/'^ so that particle-hole symmetry 
can be satisfied for each color and the atoms with each 
color achieve a balanced population at half filling. We 
set Ui2 — U, U23 — U', and U31 = U" . We assume a 
homogeneous optical lattice and neglect the confinement 
potential for a first approximation. 

To obtain a self-consistent solution in the DMFT cal- 
culations, we employ the two-site DMFT method as a 
solver [ijj. We use a semicircular density of states ob- 
tained for the infinite-dimensional bipartite Bethe lattice. 
We calculate the quasiparticle weight Za ■ To investigate 
the characteristics of a Mott transition, we further cal- 
culate the occupation rate of atoms with colors a and /3 
in the same site, Dafj — {naUp). 
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FIG. 1: (Color online) Quasiparticle weight and double 
occupancy (a) for U" /U — 1.5 and U' /U = 0.7 as a 

function of U/t, and (b) for U" /U = 1.5 and U/t = 8.0 as a 
function of U'/U. 



In Fig. [Ija), we show the results for U" /U — 1.5 and 
U'/U = 0.7 as a function of U/t. As U/t is increased, 
Za decreases monotonically. Zi and Z^ become zero at 
Uci/t = 4.7, while Z2 becomes zero at Uc2/t = 6.7. D12 
and 1^13 decrease and become zero at Uci and Uc2, re- 
spectively. On the other hand, D23 increases towards 
1/2 at Uc2 with increasing U/t. From the results for Za, 
we find that the FL state appears for U < Uci. For 
Uci < U < Uc2, atoms with colors 1 and 3 are local- 
ized at different sites as a result of the Mott transition 
caused by the strongest U". By contrast, atoms with 
color 2 are itinerant throughout the system as renormal- 
ized fermions. This is the CSMT state. In the follow- 
ing, we call the CSMT state with itinerant color-a atoms 
CSMT-a. In CSMT-a, atoms with colors (3 and 7 are 
localized at different sites owing to the Mott transition, 
leading to Dp^ — 0. Other D^a and Da/s take nonzero 
values depending on the interactions. For U > Uc2, the 
Mott insulating state appears. In this state, in order to 
avoid the collision induced by two stronger interactions, 
color-2 and 3 atoms are localized at the same sites, while 
color-1 atoms are only localized at different sites. We 
call this Mott insulating state PMI-23. We can under- 
stand this feature from the behavior of the double occu- 
pancy Dai3. In the Mott phases. Dap can be rewritten 



as Dap = J2<t, P4>dai3^ where is the weight of the local 
eigenstate 10} and df^p = {(t)\nanp\4>) . When the paired 
localized state of color-a and /3 atoms {(pa^) or the sin- 
gle localized state of a color-7 atom \(j)-y) appears ran- 
domly in each site, we obtain (d^^, d^^, rf^a) = (1,0,0) 
and (0,0,0), respectively. These two localized states are 
distributed with an equal probability, p^^^ — p^_^ — 1/2. 
We thus obtain {Dap, Dp^, D^a) = (1/2,0,0) as shown 
in Fig.[I](a). 

The CSMT state and the PMI are characteristic Mott 
transition states of three-component repulsive fermionic 
atoms in optical lattices. In the CSMT state, the itiner- 
ant atoms are influenced by the potential scattering of the 
randomly distributed localized atoms with two different 
colors, which drives the itinerant atoms to the PMI. This 
driving mechanism is different from that of the orbital- 
selective Mott transition |l7[, which appears in strongly 



correlated electron systems described by the two-band 
Hubbard model with different bandwidths. 

In Fig. [IJb), we show Za and Dap as a function of 
U'/U for U"/U = 1.5 and U/t = 8.0. In these parame- 
ters, Zi, Z3, and Di3 are equal to zero for < U'/U < 2, 
indicating that atoms with colors 1 and 3 obey the Mott 
transition driven by the strongest repulsion U". For 
U'/U < 0.7 and U'/U > 1.3, we find D12 = and 
D23 = 0, respectively, in addition to the above results. 
The results indicate that for U'/U < 0.7 {U'/U > 1.3) 
color-2 and 3 (color-1 and 2) atoms with the weakest U' 
(U) are localized at the same sites and form pairs, yield- 
ing PMI-23 (PMI-12). For 0.7 < U'/U < 1.3, color-2 
atoms are itinerant owing to frustration effects caused 
by the nearly balanced U and U' . Accordingly, CSMT-2 
appears. At U'/U = 1, Z2 becomes unity, which indi- 
cates that the renormalization effects vanish and atoms 
with color 2 behave as free fermions. 
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FIG. 2: (Color online) In [/ 7^ [/' = U" , quasiparticle weight 
Zoi and double occupancy D^p for (a) U'/U — 0.5 and (b) 
U'/U — 1.5 as a function of U/t. Since U' = U" , we obtain 
Zi = Z2 and D13 = D23. 



To clarify the strong fluctuation effects induced by 
the balanced interactions, we investigate the character- 
istics when two of the three repulsive interactions are 
the same. For this purpose, we set U ^ U' = U" . In 
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Fig. [DJa), we show and -Da/3 for V jU = 0.5. As 
\J jt increases, and Z2 decrease monotonically and be- 
come zero at Ucji = 7.1. This Mott transition for color- 
1 and 2 atoms is caused by the strongest U . On the 
other hand, Z^ first decreases and then increases non- 
trivially towards unity at the same Uc/t. Correspond- 
ing to these renormalization effects for Z3, Z)23 and I?i3 
show nonmonotonic U jt dependence and become 1/4 in 
U > Uc- The results indicate that there is a quan- 
tum phase transition from the FL to CSMT-3. Since 
U' — U", two paired localized states |0i,3) and |02,3), 
and two solely localized states \(j)2) and \(f>3) emerge with 
the same probability in each site in CSMT-3. We eval- 
uate df^p and in the same way as mentioned above, 
resulting in {Di2,Di3, D23) = (0, 1/4, 1/4). This CSMT- 
3 never obeys the transition to the PMI and the itin- 
erant color-3 atoms behave as free fermions because of 
the strong frustration effects induced by the balanced 
U' = U" . The nontrivial increase of Z3 in the vicinity of 
a transition point is due to these frustration effects. 

For U' /U — 1.5, three quasiparticle weights decrease 
monotonically and become zero at Uc/t — 5.0 as shown 
in Fig. 2(b). Since -D13, I?23, and Za vanish and D12 
becomes 1/2, we find a direct quantum phase transition 
from the FL to PML12 at Uc/t = 5.0. 
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FIG. 3: (Color online) Phase diagrams of the three- 
component repulsive fermionic atoms in optical lattices at half 
filling for (a) U" /U = 1.5, (b) U" /U = 1.0, (c) U" /U = 0.5. 
(d): Quasiparticle weight for U = U' = U" as a function of 
the atom number A*' per site. Because of the isotropic inter- 
action, Z = Zi — Z2 = Z3. 



We perform the same calculations by changing U/t and 
U' /U systematically for a given U" /U . The results are 
summarized in the phase diagrams shown in Fig. [31[a), 
(b), and (c). The FL states appear in the small U/t re- 
gions. As U/t increases, there are various quantum phase 
transitions depending on the anisotropy of the repulsive 
interactions. For U" /U — 1.5 and 0.5, we find the same 



topological features as found in the phase diagrams. For 
the large U/t regions in U" ^ U' ^ U , the two different 
color atoms possessing the strongest interaction are lo- 
calized at different sites and the third color atoms form 
pairs with atoms corresponding to the weakest interac- 
tion, which yields the PMI as shown in Fig. EJa) and (c). 
When the two weaker interactions are nearly the same, 
the CSMT state appears where atoms associated with 
the two weaker interactions are itinerant as renormalized 
fermions. When the two stronger interactions are nearly 
the same, there is a direct transition from the FL to the 
PMI with increasing U/t. In the FL state close to this di- 
rect transition line, we can expect pair fiuctuations to be 
enhanced, which may yield su per conducting fluctuations 
under appropriate conditions [l8|. 

When the two weaker (stronger) interactions are the 
same, there is a transition from the FL to the PMI 
(CSMT state) with increasing U/t. In this case, the itin- 
erant atoms in the CSMT state acts as free fermions. 
When the interactions are isotropic, there is no Mott 
transition fio', Tsj and the FL remains with increasing 
U /t as shown in Fig. [3jb) . This result can also be 
confirmed by the quasiparticle weight as a function of 
the atom number N per site. As shown in Fig. [21Id), 
Z{= Z\ — Z2 = Z3) decreases with increasing U/t and 
becomes zero only at = 1 and 2, which correspond 
to the commensurate 1/3 and 2/3 fillings. At N — 3/2, 
which corresponds to incommensurate half filling, Z re- 
mains nonzero value even at U/t — 8. 

In Fig. [3] (c), CSMT-1 appears between the FL and 
PMI-13. The quantum phase transitions from CSMT- 
1 to PMI-13 occur at the same U/t — 4.0 irrespective 
of U'/U. We discuss this feature in terms of an effec- 
tive model. When two of the three color atoms are lo- 
calized by the Mott transition at half filling, the effec- 
tive Hamiltonian can be derived jllj], which is known 
as the Falicov-Kimball model. In deriving the effective 
Hamiltonian, we transform the degrees of freedom re- 
lated to which color atom is localized at the site into 
the charge degrees of freedom of the localized spinless 
fermion. We consider the CSMT state in U'/U > 1.4 for 
U" /U = 0.5. In this case, U' is the strongest and color- 
1 atoms are itinerant. The effective Hamiltonian takes 
the form H - - ^f/ (c^ + + 

U^iC^Cifl fij where Ci (fi) is the annihilation opera- 
tor of the spinless (localized) fermion, and U — \U" — U\ 
is the effective interaction between localized and spin- 
less fermions. On the basis of the effective Hamiltonian, 
we depict Zi as a function of the effective interaction 
U/t for U'/U = 1.4, 1.6, 1.8, and 2.0. The results are 
shown in Fig. IH^a). The Zi curves decrease with in- 
creasing U/t and become zero at Uc/t ^ 2.0 irrespective 
of U'/U. As U/t approaches this critical value, the Zi 
curves for U'/U = 1.8 and 1.6 join with the Zi curve 
for U'/U = 2.0 at Uj/t - 1.65 and 1.80, respectively. 
Because U" = 0.5U, the Uj/t and Uc/t corresponding 
to these values can be evaluated as Uj/t ~ 3.3 and 3.6, 
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FIG. 4: (Color online) Quasiparticle weights (a) Zi for 
U"/U = 0.5 as a function of U/t = |[/" - U\/t for (77(7 = 
1.4, 1.6, 1.8, and 2.0, and (b) Z2 for f/"/(7 = 1.5 as a function 
of U/t = |(7' - U\/t for (77(7 = 0.6, 0.8, 1.1, and 1.3. 



respectively, and Uc/t ^ 4.0. We compare these values 
with the CSMT-1 region shown in Fig. ^c). We find 
that the boundaries between CSMT-1 and the other two 
phases agree well with Uj/t and Uc/t. 

Also for U" /U =1.5 shown in Fig. [3l^a), we depict the 
quasiparticle weights as a function of the effective inter- 
action U for U' /U = 0.6, 0.8, 1.1, and 1.3. In this case 
U" is the strongest, yielding U ^ \U' - U\ and CSMT- 
2. The results are shown in Fig. Sfb). As U/t is in- 
creased, the Z2 curves for U' /U = 0.6, 0.8, and 1.3 join 
with the Z2 curve for U' /U — 1.1, and they become zero 
at U/t — 2.0. We evaluate Uj/t and Uc/t in the same 
way and find that the regions Uj/t < U/t < Uc/t agree 
well with the CSMT-2 region shown in Fig. ^a). For 
U' /U = 1.1, where two weak interactions are nearly bal- 
anced, Z2 takes a nontrivial local maximum at (7/t ~ 0.6. 
At this value, Zi and Z^ become zero and there is a phase 
transition from the FL to CSMT-2. The nontrivial in- 
crease of Z2 towards this transition indicates that the 
renormalization effects are suppressed by the frustration 
effects caused by the nearly balanced U' and U. 

We have shown that the quasiparticle weights of itin- 
erant atoms in the CSMT state are scaled to the unified 



curve in terms of the Falicov-Kimball model. The ob- 
tained Mott transition point is Uc/t — 2.0, which agrees 
with that of the Falicov-Kimball model 19]. Judging 
from these findings, we conclude that the effective model 
well describes the CSMT state not only qualitatively but 
also quantitatively. Therefore, the present system is a 
tangible candidate for simulating interesting features of 
the Falicov-Kimball model. In addition to the Mott tran- 
sition, itinerant ferromagnetism may appear below half 
filling 'M. 

In summary, we have investigated three-component re- 
pulsive fermionic atoms in optical lattices. Depending 
on the anisotropy of the interactions, the FL, the CSMT 
state, and the PMI appear at half filling. We have shown 
that the double occupancies take characteristic values in 
these three states. A consideration of the confinement 
potential indicates that the domains of these three states 
appear as well as other state such as a band insulating 
state and commensurate 1/3- and 2/3-filling Mott insu- 
lating states. The characteristics of the domains can be 
observed via the double occupancy: For example, when 
two of the three double occupancies are close to zero, the 
PMI domain is realized. When one of the three double oc- 
cupancies is close to zero, the CSMT domain is realized. 
These domains of the Mott states appear at high temper- 
atures. At sufficiently low temperatures, other interest- 
ing domains such as the color-selective antiferromagnetic 
state and the color density-wave state are expected to 
emerge [ll|. We hope that our results contribute to the 
study of the exotic Mott states of multicomponcnt cold 
fermionic atoms in optical lattices. 
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